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1 . Title of the invention 

Terminal device 

2 . Patent Claims 

1. A terminal device with the following characteristics: In a 
terminal device which displays information or commands on an 
operator's forward field of vision in overlapping fashions, 

A forward field of vision observation mechanism which enables 
the observation of the forward field of vision of the 
aforementioned operator that serves as a background in the context 
of displaying the aforementioned information or commands is 
configured, and 

The method for displaying the information or commands is 
changed in accordance with the status of the forward field of 
vision observed through said forward field of vision observation 
mechanism. 

2. A terminal device specified in Claim 1 characterized by 
the fact that the aforementioned forward field of vision 
observation mechanism enables the observation of the color of the 
forward field of vision of the operator that serves as the 
background in the context of displaying the aforementioned 
information or commands and then changes, in accordance with the 

1 Numbers in the margin indicate pagination in the foreign text. 
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observed color of the forward field of vision, the color of the 
displayed information or commands into a color that can be easily 
identified by the operator. 

3. A terminal device specified in Claim 1 characterized by 
the fact that the aforementioned forward field of vision 
observation mechanism enables the observation of the color of the 
forward field of vision of the operator that serves as the 
background in the context of displaying the aforementioned 
information or commands and then changes, in accordance with the 
observed color of the forward field of vision, the position of the 
displayed information or commands into a position that can be 
easily identified by the operator. 

4. A terminal device specified in Claim 1 characterized by 
the fact that the aforementioned forward field of vision 
observation mechanism enables the observation of the brightness of 
the forward field of vision of the operator that serves as the 
background in the context of displaying the aforementioned 
information or commands and then changes, in accordance with the 
observed brightness of the forward field of vision, the intensity 
of the brightness of the displayed information or commands into 
one that can be easily identified by the operator. 

5. A terminal device specified in Claim 1 characterized by 
the fact that the aforementioned forward field of vision 
observation mechanism enables the observation of the brightness of 
the forward field of vision of the operator that serves as the 
background in the context of displaying the aforementioned 
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information or commands and then changes, in accordance with the 
observed brightness of the forward field of vision, the brightness 
of the displayed information or commands in such a way that a 
constant differential will perpetually be maintained between the 
brightness of the forward field of vision and the brightness of 
the displayed information or commands. 

6. A terminal device specified in Claim 1 characterized by 
the fact that the aforementioned forward field of vision 
observation mechanism enables the observation of the brightness of 
the forward field of vision of the operator that serves as the 
background in the context of displaying the aforementioned 
information or commands and then changes, in accordance with the 
observed brightness of the forward field of vision, the position 
of the displayed information or commands into a position that can 
be easily identified by the operator. 

7. A terminal device specified in Claim 1 characterized by 
the fact that the aforementioned forward field of vision 
observation mechanism enables the observation of a landscape 


proj ected 

on the forward field 

of 

vision of 

the operator 

that 

serves as 

the 

background 

in 

the 

context 

of displaying 

the 

af orement ioned 

information 

or 

commands and 

then changes, 

in 

accordance 

with 

the change 

of 

the 

landscape 

projected on 

the 


observed forward field of vision, the position of the displayed 
information or commands. 

8. A terminal device specified in Claim 7 characterized by 
the fact that the aforementioned forward field of vision 





observation mechanism enables the observation of a landscape 
projected on the forward field of vision of the operator that 
serves as the background in the context of displaying the 
aforementioned information or commands and then changes, in 
accordance with the change of the landscape projected on the 
observed forward field of vision, the position of the displayed 
information or commands in such a way that the information or 
commands will be displayed at a /2 

fixed position within the landscape projected on the observed 
forward field of vision. 

9. A terminal device with the following characteristics: In a 
terminal device which displays information or commands on an 
operator's forward field of vision in overlapping fashions, 

Said terminal device is mounted on a transportation vehicle, 
and the position for displaying the information or commands is 
changed, based on the information on the movement of said 
transportation vehicle and on information specific to a path on 
which said transportation vehicle is operated, in such a way that 
information concerning a specific point on said path will be 
displayed at a position corresponding to said point as it is 
projected on the forward field of vision of the aforementioned 
operator . 

3 . Detailed explanation of the invention 

(Industrial application fields) 
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The present invention concerns a terminal device, and more 
specifically, it concerns a display method for a terminal device 
such as a heads-up display which is used for displaying 
information or commands on an operator's forward field of vision 
in overlapping fashions. 

(Prior art) 

CAr_-heads-upIZdispray^ which represents a type of terminal 
devices, is used mainly as a mechanism for providing an operator 
with information or commands necessary for airplane takeoff and/or 
landing, navigation, etc. More specifically, the information or 
commands scheduled to be given to the operator is displayed on the 
operator's forward field of vision in overlapping fashions, and 
therefore, the operator can maneuver the plane by exclusively 
observing the outside without casting alternate glances at the 
instrument board and the forward field under the most challenging 
operative conditions, namely during the takeoff /landing, etc. 

An operator for an airplane equipped with no heads-up display 
must operate the plane while decoding the airplane flight statuses 
and course designations from multiple instruments on the 
instrument board, and (s)he must cast alternate and frequent 
glances between the outside and the instrument board under 
challenging operative conditions, namely during the 
takeoff /landing, etc. In such a case, the operator must switch 
his or her eye focus from infinity to short distance modes. The 
human eye, however, cannot render instantaneous responses, due to 



which a momentary blank period arises, and accordingly, not only 
does the experienced tension increase, but the degree of danger 
also becomes higher. 

As far as the heads-up display is concerned, on the other 
hand, the necessary information or commands are displayed on the 
operator's forward field of vision in the infinity focal mode, and 
therefore, the operation can view such vital information or 
commands while simultaneously observing the outer landscape. As a 
result, the operation load imposed on the operator can be 
alleviated, and the safety can be ensured. 

Incidentally, an example of the devices of the prior art is 
mentioned in Isao Iwasaki, "Trends and problems of heads-up 
displays," Nihon Koku Uchu Gakkaishi , Vol . 36, No. 408 (January 

1988) . 

(Problems to be solved by the invention) 

As far as the aforementioned technique of the prior art is 
concerned, however, it is often difficult for the operator to 
identify the displayed information or commands depending on the 
state of the forward field of vision in a case where the operator 
is assigned to a t e :qml *naJ» ««»deyic e wherein the information or’’ 
c o mmandSg^GQ nSitr i-.t.ute^ a da.iS'g»l*aiyiBg>back q-round-. (display operator = 
airplane pilot in the case of the aforementioned airplan e heads,^uq* 
d-i-s pl»ay«)>, an d it cannot be said that adequate measures are taken 
for facilitating the identifications of the information or 
commands by the operator . 



/ 


The objective of the present invention, which has been 
^conceived for solving the foregoing problem, is to provide a 
terminal device which is capable of displaying information or 
commands that can be easily identified by an operator regardless 
of the state of the operator's forward field of vision. 

c ( M^hahr s m-f © r~s o 1 v ingVIt he_ _pr Qb ITems ) 


The following constitution is provided by the present 
invention for achieving such an objective: In a terminal device 
which di-spi-ays— - information? or commands on an coperatorrsz:forward> 
cf±elhl"bf— \Trsix>n~:in overlapping fashions, a fdrwa-rd— f-i^id^^fcvi-sio^ 
ob servatio n mechanism which enables the observation of the forward 
f j-p-l-d— o£ — v-i- s.-i-.on-, of the aforementioned operator that serves.— as— a. 


in the contexts of displaying the aforementioned 
information or commands is c /~y 

^configured , and the method for di-spiaying— the— inf ormahio^. or ^ 
^copnands- is— changed in accordance with the status of the forward 
i field of vision observed through said forward field of vision 
\ observation mechanism, based on which information or commands that 
are easily identified by an operator can be displayed. 


(Functions) 

The method for displaying the information or commands is 
changed in accordance with the status of the operator 1 s forward 
field of vision based on the aforementioned constitution, by 



virtue of which the operator can always identify the displayed 
information or commands with ease. 


(Application examples) 

In the following, application examples of the present 
invention will be explained with reference to figures. 

<agiai-].r er?qL-i is a diagram which shows the overall constitution of 
the first application example of the terminal device of the 
present invention. 

is a signal processing unit that formulates 
information or commands displayed for an operator or symbols which 
represent such information * or commands (in the following, said 
information or commands displayed for an operator and symbols 
which represent such information or commands will be referred to 
collectively as the "symbols"), whereas “('f 2 )’ is a ©R-T which 
displays such ^symbols based on the signals transmitted from the 


^signal proces sin g juni t*»<(rl-.).7? whereas (3) is an op't5d r ea^»sy»s<te:em»>wh i c h 
converts the symbols displayed on the @R®Si(.2"l? into infinity- 


rfb eWs l ^i £r in!a'g^~s _ '*f 6 rl the operator, whereas (^P)^ is a co mbiner^ which 
overlaps the symbols with a 1'affii’H'? 


^ eMsaroye cted j on the operator 1 s 
forward field of vision, whereas ■(*§-) is a e®*l*©55^®'aineas&y which/ 


^photographs the Operator 1 s f orward f field of vision. 

The ,-s ignai - process ing' unit *(«!H»‘processes— informat ion "input ted 


from' an exteecaaaa«L'*»»S'®' , ia>s©e^. (e . g . , signal obtained from 



etc . ) , de t e rmine s— t-he— 


j,7yor (display p o.s.i.t lo rn 


of the symbols to” be displayed for the operator, — and then ou t puts — y 




signals that are necessary for the display into the CRT (2) . The 
signal processing unit (1) , furthermore, .images t he forward field 


of vision photographed by the color camera (5) on-screen, based on 
which the color and brightness of the forward field of vision are 


''■identified.. 


In a case where the color of' the symbol to be 


drspl-aye'd—rs— identri ca-1— tonthez 

f i-e-id— : o:f=-Vi~s±on— t'hat~constd P-ut -es— a(^ba gkar.o.und-^oT t he -s vmbelr.'or.;.^ 
wher.e=i.t=i:s: 


aHOHSBGHirJte 


siwi n n a o io pj l~ w si o n cj 


to— an~lnsuf:f:lclent 7 ^cont:rast-/b etween— the— re speet-iver:coTor.s— of— bo.th -71 


f the signal processing unit g^^ change s -/~ t he display position of the 
symbol", into a position at which the operator can easiity— lde nti-fv-- 
s a i d symbo 1 ba'sed~onrr a— Situfe&^iG-ientrrssanteasa'S'fe^beifew.ee'n^&he^respectrive—^ 

diagram which shows the relationship between the symboT? and 


hand. scape projected concomitantly on the operator's forward field 


of vision. 


/ 


Fi gure— 3^, which pertains to the s econd—applicatl on example of , 


the present invention, is a modelwise diagram which shows the 
relationship between the symbol and la ndscap e projected 
concomitantly on the operator's forward field of vision in a case 
where the respective colors of the symbol to be displayed and the 
portion of the forward field of vision that constitutes the 
b ackgroun d for said symbol are mutu ally identica l or where it is 
difficult for the operator to identify the symbol due to an 
insufficient contrast between th e respective c olors of both (e.g., 
where the color [of the symbol is] complementary to that of the 



background) . The significance of this method lies in the symbol 
display position, and it is effective in a case where it is 
undesirable to change the display position or where the symbol 
cannot be easily identified by simply changing the display 
position due to the identicalness or similarity of the color of 
the forward field of vision. 

®§?gur r e > 4 , which pertains to the t h±rdt~ap pl~rc at ion example of 
the present invention, is a modelwise diagram which shows the 
relationship between the symbols and nbandscape projected 
concomitantly on the operator's forward field of vision in the 
context of the repositioning of the symbol display position by the 
signal processing in a case where the respective 

bright nes s es of the symbol to be displayed and the portion of the 
forward field of vision that constitutes the /background. for said 
symbol are mutually identical or where it is difficult for the 
operator to identify the symbol due to an ins:uf:£±crent~contrast 
between the respective brightnesses of both. 


Faguarje — 5,7 which pertains to the f ou-r-th:- 'app-Ti-.cat--ion example of 
the present invention, is a modelwise diagram which shows the 
relationship between the s-ymb©d===- and landscape projected 
concomitantly on the operator's forward field of vision in the 
context of the redesignation of the symbol brightness by the 
signal processing unit (1) in such a way that the symbol will 
become— brri-ghterz=bhan—bhe=:baekgr:ound—i-n=a=ease where the respective 


brightnesses of the symbol to be displayed and the portion of the 
forward field of vision that constitutes the background for said 
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symbol are mutually identical or where it is difficult for the 
operator to identify the symbol due to an insufficient contrast 
between the respective brightnesses of both. If a constant 
differential is orchestrated to be perpetually maintained between 
the brightness of the background and the brightness of the symbol 
in this case, furthermore, the displayed symbol continually' 


remai ns highlighted against the background— in the operator 1 s field 
of vision at a constant .eonferast— ratio. 


based on which the symbol can be accurately recognized without 


t 


entailing unnecessary tension for the operator due to the 
irregularity of the highlighting intensity. Depending on the 
types of symbols, furthermore, accidents such as the overlooking 
of an important symbol, etc. can be avoided if the brightness of a 
symbol with a high degree of significance is designated to be 
higher not only than the brightness of the background but also 
than the brightness of the other symbols. 

Next, the f i fbh— appl-reatl -on example of the present invention 
will be discussed below. 

The fifth application example is especially effective in a 
case where the terminal device of the present invention is 
utilized as a heads-up display for an operator of a transportation 
v ehicle (e.a.. airplane, automobile, etc.), and a case where it is 
mounted on an automobile will be instantiated below in the present 
application example. _|_j (J J^) 


One notable characteristic of a case where the terminal / 3 3 


devic e of the present invention is mounted on an automobile lies 
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in the continuous cha-nge-, of the <J;aaadiS?cape proj ected on the forward - 


fiel d of vision in accordance with the •movement’ of the automobile. 
whereas another lies in the fact that i nformati on vital to the 
operator of the automobile (equivalent to the operator of the 
terminal device) is often peculiar to a certain point within the. 



J 


Figure 6-,= , which is provided for e xplaining these 

c haracteristics . is an approximation diagram which shows the - 
manner by which the automsbi-le— (-6 1 )' , on which the t e rminaT : ^e^i r ee > 
of the present invention is being mounted, t raveis— on~the=^road . 
The intersection cfc7 ~b is located in front of the automobile L6:b 
along its direction of movement, whereas the' : ro^d^informatig^ 
transmission device (8) p which transmits, to a vehicle traveling • 


1 


.ahead, sets of information such as the distance to the 


intersection (7) , respective branching destinations of the 
intersection (7), etc., is installed on the side of the road along 
which the automobile (6) travels, namely on its left side. Figure: 


=3=>is a diagram which shows the forward field of vision of the 


operator of the automobile (6) at the moment where said automobile 
has passed in front of the road information transmission device 
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(8),. The respective branching destinations of the intersection 


(7) are her eby dis played as symbols. Such an embodiment wherein 
the ''s ymbol s that express the respective bra nching destinations are 
displayed on the respective branching roads projected on the 




& X€, CaA. 
-A >-4 jxuSi 


operator's forward field of vision can be realized with ease by 


using not only the information concerning the distance to the 



intersection (7) , which has been transmitted from the road 
information transmission device (8) , but also the standard 
positional profile from the operator's perspective . In a case 
where the symbol display position remains fixed at an invariable 
position within the forward field of vision, however, the 

lfa>nd^ap.e w p^^ie i Gfee.dCT©n^feh F e’*^p'e'rafe r or^s^fi.©/2iW;a-Kd«ra»&ieJ3d?BSieh&Bs^«jS.ivQne, 

cha »n6?6s^bn.iaa.ec©]gdance with the cm©vemenfewQ/f»»the«».aubomQbri-,li.e J Tv t ( 1 §j , and 
therefore, th e §jpnfe>-©4« eid»i splay position comes to progressively 
deviate from the position of each branching road which is being 
projected on the forward field of vision, as Figure 8 indicates. 

As the overall constitutional diagram of Figure 9 indicates, 
as far as the fifth applicati on example is concerned, the signal 
processing unit (1) receives not only the information from the 

road information transmission device (8) but also the traveling 
velocity, movement direction, and posture of the automobile (6) 
and then shifts the symbol display position within the operator's 
forward field of vision in accordance with the movement of the 

automobile (6) . In the case of the state shown in Figure 6, the 

distance between the automobile (6) and intersection (7) is 

calculated based not only on the time elapsed since the passage of 
the automobile (6) in front of the road information transmission 
device (8) but also on the traveling velocity of the automobile 
(6) , as a result of which the symbol becomes constantly displayed 
on each branched road at the intersection (7) (Figure 10) . 

Incidentally, in the case of the state shown in Figure 6, the 
road is straight, and the movement direction of the automobile (6) 



and its posture in relation to its movement direction are 
constant, due to which the traveling velocity of the automobile 
(6) alone is used for the calculation executed in the context of 
shifting the symbol display position by the signal processing unit 
(1) , although it goes without saying that such sets of information 
as the movement direction and posture of the automobile (6) can 
also be inputted for effectively implementing the present 
invention in relation to roads with complex shapes. 

Effects similar to those of the case of the automobile can, 
furthermore, be achieved by directly mounting the terminal device 
of the present invention on transportation vehicles other than the 
.automobile (e.g., airplanes, trains, etc.). 

(Effects of the invention) 

As has been mentioned above, as far as the present invention 
is concerned, the method for displaying information or commands is 
changed depending on the status of the operator's forward field of 
vision, based on which it becomes possible for the operator to 
constantly identify the displayed information or commands with 
ease regardless of the status of the forward field of vision. 

4 . Brief explanation of the figures 

Figure 1 is a diagram which shows the overall constitution of 
the first application example of the terminal device of the 
present invention, whereas Figure 2 is a modelwise diagram 
pertaining to the forward field of vision of the operator of the 



terminal device, whereas Figures 3, 4, and 5 are respectively 

modelwise diagrams pertaining to the forward fields of vision of 
the operators of the terminal devices of the second, third, and 
fourth application examples of the present invention, whereas 
Figure 6 is a demonst rational diagram pertaining to the traveling 
state of an automobile on which the terminal device of the fifth 
application example of the present invention is being mounted, 
whereas Figure 7 is a modelwise diagram pertaining to the forward 
field of vision of the operator of the terminal device of the 
fifth application example of the present invention, whereas /5 
Figure 8 is a modelwise diagram pertaining to the forward field of 
vision of the operator of a terminal device of the prior art, 
whereas Figure 9 is a diagram which shows the overall constitution 
of the fifth application example of the present invention, whereas 
Figure 10 is a modelwise diagram pertaining to the forward field 
of vision of the operator of the fifth application example of the 
terminal device of the present invention. 

(1) : Signal processing unit; (2) : CRT; (3) : Optical system; 
(4 ) : Combiner; (5): Color camera; (6): Automobile; (8): Road 
information transmission device. 


Agent: Katsuo Ogawa, patent attorney 
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[(A) : Operator's eye; (B) : Symbol; (C) : Type; (D) : Color; (E) 
Brightness; (F) : Display position; (G) : Sensor, etc.; (H) 

Image of forward field of vision; (1) : Signal processing unit] 
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Figure 2 

[(A) : Operator's forward field of vision; (B) : Symbol; (C) : Symbol 
display position shift direction] 

Figure 3 

[(A) : Operator's forward field of vision; (B) : Symbol; (C) : Symbol 
color change] 
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Figure 4 

[(A) : Operator's forward field of vision; (B) : Symbol; (C) : Symbol 
display position shift] 

Figure 5 

[(A) : Operator's forward field of vision; (B) : Symbol; (C) : Symbol 
brightness change] 
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Figure 8 

[(A): City A; (B) : City B; (C) : City C; (D) : Symbol; (E) : 
Operator's forward field of vision] 


Figure 9 


[(A) : 

Operator ' s 

eye; (B) : Symbol; 

(C) : 

Type; (D) : 

Color; 

(E) : 

Brightness; (F) : 

Display position; 

(G) : 

Sensor, . . . , 

etc . ; 

(H) : 

Image 

of forward 

field of vision; 

(I) : 

Movement of 

automobile; 


(J) : Travelling velocity; (K) : Movement direction; (L) : Posture; 
(1) : Signal processing unit] 


Figure 10 

[(A): City A; (B) : City B; (C) : City C; (D) : Symbol; (E) : 
Operator's forward field of vision] 
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